Frame, Reproducing Kernel, Regularization and Learning
نویسندگان
چکیده
This works deals with a method for building Reproducing Kernel Hilbert Space (RKHS) from a Hilbert Space with frame elements having special properties. Conditions on existence and method of construction are given. Then, these RKHS are used within the framework of regularization theory for function approximation. Implications on semiparametric estimation are discussed and a multiscale scheme of regularization is also proposed. Results on toy approximation problems illustrate the effectiveness of such methods.
منابع مشابه
Frames, Reproducing Kernels, Regularization and Learning
This work deals with a method for building a reproducing kernel Hilbert space (RKHS) from a Hilbert space with frame elements having special properties. Conditions on existence and a method of construction are given. Then, these RKHS are used within the framework of regularization theory for function approximation. Implications on semiparametric estimation are discussed and a multiscale scheme ...
متن کاملWeight-decay regularization in Reproducing Kernel Hilbert Spaces by variable-basis schemes
The optimization problems associated with various regularization techniques for supervised learning from data (e.g., weight-decay and Tikhonov regularization) are described in the context of Reproducing Kernel Hilbert Spaces. Suboptimal solutions expressed by sparse kernel models with a given upper bound on the number of kernel computational units are investigated. Improvements of some estimate...
متن کاملReproducing Kernel Banach Spaces with the ℓ1 Norm II: Error Analysis for Regularized Least Square Regression
A typical approach in estimating the learning rate of a regularized learning scheme is to bound the approximation error by the sum of the sampling error, the hypothesis error and the regularization error. Using a reproducing kernel space that satisfies the linear representer theorem brings the advantage of discarding the hypothesis error from the sum automatically. Following this direction, we ...
متن کاملSolving integral equations of the third kind in the reproducing kernel space
A reproducing kernel Hilbert space restricts the space of functions to smooth functions and has structure for function approximation and some aspects in learning theory. In this paper, the solution of an integral equation of the third kind is constructed analytically using a new method. The analytical solution is represented in the form of series in the reproducing kernel space. Some numerical ...
متن کاملLearning Rates of Least-Square Regularized Regression
This paper considers the regularized learning algorithm associated with the leastsquare loss and reproducing kernel Hilbert spaces. The target is the error analysis for the regression problem in learning theory. A novel regularization approach is presented, which yields satisfactory learning rates. The rates depend on the approximation property and the capacity of the reproducing kernel Hilbert...
متن کامل